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Abstract 

What constitutes jointly Poisson processes remains an unresolved issue. This report reviews 
the current state of the theory and indicates how the accepted but unproven model equals that 
resulting from the small time-interval limit of jointly Bernoulli processes. One intriguing con- 
sequence of these models is that jointly Poisson processes can only be positively correlated 
as measured by the correlation coefficient defined by cumulants of the probability generating 
functional. 

1 Introduction 

To describe spike trains mathematically, particularly those that do not produce deterministic se- 
quences of spikes, point process models are usually employed. From a mathematical viewpoint, 
the Poisson process is the simplest and therefore the model that has yielded the most results. Here, 
events occur randomly at a rate given by some function X{t) with no statistical dependence of one 
event's occurrence on the number and the timing of other events. Unfortunately, Poisson processes 
cannot accurately describe spike trains because of absolute and relative refractory effects. Here, 
the occurrence of a spike influences when the next one occurs. Some spike trains deviate even 
more from the Poisson model, with several spikes affecting subsequent ones in complicated ways. 
Modeling these falls under the realm of non-Poisson processes, which in many cases makes it very 
difficult to obtain analytic results. Consequently, the Poisson model is used to obtain predictions 
about the character of the spike train, like its information capacity, that are understood not to be 
precisely accurate for any realistic neural recording. In some cases, the Poisson process can be 
used to obtain bounds on performance that can be used as well-established guideposts for neural 
behavior. 

When it comes to population models, in which several neurons presumably jointly encode infor- 
mation, we lack even a Poisson model for all but the simplest cases: the component point processes 
are either statistically independent or conditionally independent. Data show more complicated be- 
havior since cross-correlation functions often show correlations among members of a population. 
Consequently, what is the generalization of the single Poisson process description to what could be 
termed the jointly Poisson model. Here, we seek to describe the joint statistics for several processes, 
each of which is Poisson (i.e., the marginal processes are Poisson). 

2 Infinite Divisibility 

From a probabilistic standpoint, specifying a unique joint probability distribution that has specified 
marginal distributions is ill-posed, since many joint distributions could conceivably work. The 
easiest way to show the ill-posed nature of this problem is to consider the situation for Gaussian 
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random variables. A set of random variables {Xi , . . . ,Xm} is said to be jointly Gaussian if the joint 
probability density has the form 

1 f (x-mVirVx-m)! 
Px(x) = p^p eXP | 2 -|,X = {X 1 ,...,X M } 

Here, £ is the covariance matrix, | • | represents the matrix determinant, m is the vector of means and 
x' represents the transpose of the vector x. Each of the random variables has a Gaussian marginal 
probability distribution. One can also find a joint distribution not of this form that also has Gaussian 
marginals. For example, consider the two-dimensional case (N = 2) when the means are zero. Let 
the joint distribution be as written as above, but defined to be zero in the first and third quadrants. 
To obtain a valid joint distribution, we must multiply the above formula by two so that the total 
probability obtained by integration is one. This joint distribution yields marginal distributions no 
different from the jointly Gaussian case, but the random variables are not jointly Gaussian because 
the joint distribution does not have the form written above. 

What makes the jointly Gaussian random vector special is the property of infinite divisibility: 
the random vect or can be expressed as a sum of an arbitrary number of statistically independent 



random vectors (IDaley and Vere-Jonesl . 119881) . The probability distribution of the sum is the con- 
volution of the individual probability distributions. Consequently, infinite divisibility demands that 
a probability distribution be expressed as the rc-fold convolution of a density with itself. In spe- 
cial cases, like the Gaussian and the Poisson, each of the constituent random vectors has the same 
distributional form (i.e., they differ only in parameter values) as do their sum. 

The characteristic function provides a more streamlined definition of what what infinite divisi- 
bility means. The characteristic function of a random vector X is defined to be 



X Qu) = J Px (x)e^dx. 



The characteristic function of a sum of statistically independent random vectors is the product of 
the individual characteristic functions. 

< J > Y(7u) = nOx,(7'u) Y = £X ; - 

(=1 i=l 

Infinite divisibility demands that [<I>y(./'u)] also be a characteristic function for any positive 
integer value of n. If we express a characteristic function parametrically as <&(ju; 6), with 6 denotes 
the probability distribution's parameters, the Gaussian case is special in that [<I>y(./'u; 0)] = 
<J>y(ju; 6/n). For the jointly Gaussian case, these parameters are the mean and covariance matrix. 

<I>x ; (iu;m,-,E,-) = exp {./ii'm,- - u'E,-u/2} 

Dividing these parameters by n does not affect the viability of the underlying Gaussian distribution, 
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which makes it an infinitely divisible random vector. The example given above of a bivariate dis- 
tribution having Gaussian marginals is not infinitely divisible as its characteristic function does not 
have this property. 

In the point process case, a single Poisson process is easily seen to be infinitely divisible since 
the superposition of Poisson processes is also Poisson. We must modify the just-presented math- 
ematical formalism involving characteristic functions because we have a random process, not a 
random vector. The probability-generating functional is defined as 



G[u(t) 



exp 



J\ogu(, 



t)dN t 



where the transform variable u(t) is a real-valued function of time and N t is the point process's 
counting function (the number of events that have occurred prior to time t). It has similar proper- 
ties to the moment-generating function with one notable exception: it has no "inverse transform." 
However, the moment-generating function for the total number of counts in the interval implicit in 
the integral can be found from the probability generating function with the substitution u(t) — > z. 
Finding the probability distribution that underlies the expected value in the above formula requires 
a special series expansion. Interesting quantities, like moments can be found from the probability- 
generating functional by evaluating derivatives of its logarithm. For example, the formal derivative 
with respect to w(-) and evaluating the result at u(-) = 1 yields the expected value. 



1 



dlogG[u(t)} _ 

du(t) ~ G[u(t)\ 

d\ogG[u(t)\ _ 1 



du(to) 



G[u(t)\ 



\ [\ogu{t)dN t \ =E fdN t 

J J u(t)=l 



J u(t) dNt CXP { / IO§ dN ' 
■^pjdN t0 exp | J \ogu(t)dN, 



u(t)=l 



E[dN t0 ] 



The first of these is the total variation with respect to u(t) and yields the expected number of events 
over the interval spanned by the integral. The second is the derivative at the time instant to, which 
yields the expected value of the process at that time instant. 

Despite not being easily able to determine the probability distribution, showing infinite divis- 
ibility can be seen by inspection just as with characteristic functions. For a Poisson process, the 
probability-generating functional has the special form 



G[w(7)] = exp 



To show infinite divisibility, we note that the only "parameter" of a Poisson process is its instanta- 
neous rate function X{t). As the product of probability-generating functionals for Poisson processes 
yields the same form with the total rate equaling the sum of the component rates, the Poisson pro- 
cess is infinitely divisible. 

What we seek here is a description of the joint probability distribution of several marginal 
Poisson processes so that the vector of Poisson processes is infinitely divisible. We exhibit here 
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what the probability generating functional for an infinitely divisible vector of Poisson processes 
must be and show how to use this quantity to derive some of its properties. In particular, we show 
that they can be constructed in a stereotypical way that elucidates the cross-correlation behavior 
required of jointly Poisson processes. Somewhat surprisingly, the range of correlation structures 
is quite limited, with values for the correlation parameters tightly intertwined with each other and 
with the dimensionality of the vector process. In particular, pairwise correlation coefficients cannot 
be negative for any pair and must decrease as the dimension increases. 

3 Jointly Poisson Processes 

The probability-generating functional for several point processes considered jointly has the simple 
form 



exp 




\ogu m {t)dN m ,t 



(1) 



where the expected value is computed with respect to the joint distribution of the point processes, 
which is the quantity we seek. The probability-generating functional of component process j can 
be found from this formula by setting U{(t) = 1, i ^ j. If the processes are statistically independent, 
their joint probability functional equals the product of the marginal functionals. If the processes are 
added, the probability generating functional of the result equals the joint functional evaluated at a 
common argument: G[m(?)] = G^[u(t),u(t), . . . ,u(t)]. These properties generalize those of mo- 
ment generating functions. Furthermore, cross-covariance between two processes, i and j say, can 
be found by evaluating the second mixed partial of the log joint probability-generating functional: 



d 2 logG^[u(t)] 



dui{t)duj(t) 
d 2 logG( M )[u(f)] 



dui(ti)duj(tj) 



u(f)=l 



11(0=1 



dNuj dN u 



dN it 



dNj, 



E [dN iA dN Uj ] - E [dN^ ■ E [dNjfj] 



Again, the first expression gives the cross-covariance of counts while the second gives the cross- 
covariance between the processes i, j at the times f,,fy. 

Over thirty years ago, the probability-generating functional of two marginally P oisson proces ses 



that satisfied the infinite-divisibility condition was shown to have the unique form dMilnel 1 19741) 



G^[ui(t),u 2 (t)] =expi J (m(t)-l)vi(t)dt + J (u 2 (t)-i)v 2 (t)dt 



+ / / (ui(j)m2(0 - i)v e (a,P)da dp } . (2) 



This joint probability-generating functional is easily interpreted. First of all, by setting u 2 {t) = 1, we 
obtain the marginal probability -generating functional of process 1, showing that it is a Poisson pro- 
cess having an instantaneous rate of V\{t) + / V c (t,f5)df5. Similarly, process 2 is also Poisson with 
a rate equal to V 2 (t) + / v c (a,t)da. Also, setting V c (s,t) = results in the product of the marginal 
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probability-generating functionals, corresponding to the case in which the processes are statisti- 
cally independent. Thus, the "common rate" v c (a,j3) represents a joint rate variation that induces 
statistical dependence between the processes. The simplest example is v f (ce,/$) = v c (fi)8(a — j8), 
indicating an instantaneous correlation at each moment in time. The resulting dependence term in 
the probability generating functional equals 

J J (ui(a)u 2 (fi) - l)v c (a,P) da dp = J ( Ul (t)u 2 (t) - \)v c (t)dt . 

Statistically dependent Poisson processes having an infinitely divisible joint probability distri- 
bution can be simply constructed by adding to statistically independent Poisson processes having 
rates Vi (?) and V 2 (t) — what we call the building-block processes — a common Poisson process hav- 
ing rate v c (t) that is statistically independent of the others. Thi s way of const ructing jointly Poisson 



processes amounts to the construction described by Holgate (Hol gatd. I1964T) . An allowed variant 
is to delay the common process when it is added to one but not the other building-block process. 
Here, v c (o;,j8) = V c (j3)5 (a — (j3 — to)). In this way, correlation can occur at a time lag other than 
zero, but still only at a single point. 

More generally, v c (s,t) depends on its arguments in different ways that do not lead to a simple 
superposition of building-block Poisson processes. Using the probability generating function, you 
can show that the cross-covariance function between the two constructed processes equals the com- 
mon rate: COV [dN\ !tl ,dN 2! t 2 ] = V c (fi,f2). One would think that many common cross-covariances 
could be described this way. However, several important constraints arise. 

• Cross-covariances must be non-negative. This condition arises because the common rate 
must be non-negative so that a valid probability generating functional results. 

• For the constructed processes to be jointly (wide-sense) stationary, we must have constant 
rates and a cross-covariance function that depends only on the time difference. Here, the latter 



constraint means v c (s,t) = f(\s — t\). Milne and Westcott (|Milne and Westcoti I1972T) give 
more general conditions for the common rate function to be well-defined. Thus, correlation 
can extend continuously over some time lag domain. Consequently, the Holgate construction 
does not yield all possible jointly Poisson processes. 

It is not clear that the joint -rate characterization ext ends in its full generality to more than 



pairs of Poisson processes (IMilne and Westcoti 1 19931) because the putative probability gen 



erating functional for the marginal process has not been shown to correspond to a Poisson's 
probability generating functional. However, the special case of the Holgate construction tech- 
nique always works. 

In sequel, we only consider jointly Poisson processes that can be constructed in Holgate's fashion 
as a superposition of building-block Poisson processes. 

Calculating means and covariances from the probability generating functional for jointly Pois- 
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son processes is very revealing. 

Counts: 

Instantaneous: 



cov 



J dN Lt = J (Vi(t) + v c (t))dt 

J dN u ,J dN 2 , t = J v c (t)dt 
E[dNu] = Vi(t) + v c (t) 



COV [dN htl ,dN 2 , t2 ] 



0, h / t 2 
v c (t), t 1 =t = t 2 



Since the variance of a Poisson process equals its mean, we find that the second-order correlation 
coefficient p^ 2 \t) equals 



Counts: 



Instantaneous: 



P (2) W 



P (2) W 



Jv c (t)dt 



yjl{vi(t) + v c (0) dt ■ /(v 2 (0 + v c (0) dt 

0, h / 1 2 

t 1 =t = t 2 



Vc(0 



V(vi(f)+v c («))(v 2 («)+v c (f)) ! 



Thus, the correlation coefficient between both the counts and the instantaneous values lies in the 
interval [0, 1], with the maximal correlation occurring in the limit of large values for the common 
rate. However, note that correlation has no temporal extent and for some particular lag: given an 
event occurs in one process, it is correlated with the other process at the first process's event time 
and uncorrected (statistically independent) at all others. 

We can write the probability-generating functional in terms of the rates of the building-block 
processes, v,-(f) and v c (t), or in terms of the rates of the constructed processes Xi{t) = v,-(7) + v c (t) 
and the correlation coefficient p^ 2 \t) given above. 

G (2) [m(t),u 2 (t)} =exp|y (m(t)-l)vi(t)dt + J (u 2 (t)-l)v 2 (t)dt 

+ J(m{t)u 2 {t)-\)v c {t)dt^ 
G (2) [ Ul (t),u 2 (t)} =exp^J(ui(t)-l)k 1 (t)dt + J(u 2 {t)-\)X 2 {t)dt (3) 
■J(m(t) - 1) {u 2 (t) - l)p( 2 \tWh(t)h(t)dt 



+ 



We can extend this type of analysis to three Poisson processes constructed from six building- 
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block processes according to the following formulas for their rates. 

Xi(t) = vi(r) + v 4 (0 + v 5 (0 
X 2 {t) = vi(r) + v 4 (0 + V6(0 
A 3 (0 = v 3 (0 + v 5 (0 + v 6 (0 

This generates pairwise-dependent processes with no third-order dependencies. The covariance be- 
tween any pair is expressed by the building-block process rate they share in common. Consequently, 

By letting Vi = V2 = V^ 1 ) and V4 = V5 = Ve = v^ 2 \ we create what we term the symmetric 
case, in which we have only two separately adjustable rates that arise from the six statistically 
independent building-block processes. In this case, this cross-correlation simplifies to 

p( 2 ) = ^ <I W (4) 

P v(D(f)+2v( 2 )(f) -2' W 

When a Poisson process having instantaneous rate v^(t) is added to all three building-block 
processes to create third-order dependence, the correlation coefficient becomes in the symmetric 
case 

9 V(!)(0+2V( 2 )(0 + V( 3 )(0' ^ J 

Now, as the common process's rate grows, the pairwise correlation coefficient can approach one. If 
we define a third-order correlation coefficient according to 

d 3 logG[«i(f),« 2 (Q,M3(0] 
(3)tjxr JAr 1 A d Ul (t)du 2 (t)du 3 (t) 

p [ ) \dN lt ,dN2t,dN3t}= , =■ (5) 

For the symmetric Poisson example, the third-order correlation coefficient is easily found to be 



p (3) (0 



V (1)(;) +2V ( 2 )(0 + V( 3 )(0 



Combining with the expression for the second-order correlation coefficient, we find the following 
bounds for the symmetric case relating the correlation quantities. 

0<p( 3 )<2p( 2 )-p( 3 )<l 

Note that this inequality chain indicates that < p^ < p^ < 1. The second-order correlation can 
be bigger than 5, but only if p( 3 ) increases as well in a manner defined by the inequality chain. 
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We need to extend this analysis to an arbitrary number of building block and constructed pro- 
cesses. We can form an arbitrary number of infinitely divisible, jointly denned Poisson processes 
by extending the two- and three-process Holgate construction technique. Given L statistically inde- 
pendent Poisson processes, we create a population of M statistically dependent Poisson processes 
according by superimposing L building -block processes according to the construction matrix A: 
Nf = AB f . Here, N ; and B t represent column vectors of constructed and building -block Poisson 
processes of dimension M and L> M respectively. The entries of the construction matrix are either 
or 1. For example, the construction matrix underlying the two- and three-process examples are 



M = 2: A 



M = 3: A 



1 1 
1 1 

10 110 1 
10 10 11 
10 111 



To introduce dependencies of all orders, L > 2 M — 1, and we concentrate on the case L = 2 M — 1 in 
sequel. 

The probability generating functional G^ M ' [u(/)] of N ? expressed in (fl]) can be written in matrix 
form as 



expi j logu'(?)<iN, 



G^[u(t)} = E 



where the logarithm of a vector is defined in the Matlab sense (an element-by-element operation). 
Because N t = AB,, we have 



gW[u(0] = e 

= E 



Each component of the vector A'logu(f) expresses which combination of components of u(t) are 
associated with each building block process. This combination corresponds to the constructed 
processes to which each building block process contributes. Since the building block processes are 
statistically independent and Poisson, we have 



exp j J logu'())A<iB f 
expjy" (A'logu(O)'rfBf 



G^[u{t)} = f [exp{A'logu(0}-l]'v(0* 



Expanding the vector notation for a moment, this result can also be written as 



GW[u(0]=exp|t/ 



M 



m=l 



1 Vi(t)dt 



(6) 



Here, w m "' ' (t) means u m (t) raised to the A m j power. In other words, if A m j = 1, the term is included; 
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if A ra j = it is not. Thus, the probability generating functional consists of a sum of terms, one for 
each building block process, wherein the coefficient of each rate V/(?) is the product of arguments 
corresponding to those constructed process building block process / helped to build minus one. This 
form is what equation © describes. 

However, we need to convert this result into the form of (O so that the role of the cumulant 
correlation coefficients can come to light. We can view the cumulant moments, the mixed first 
partials of the logarithm of the probability generating functional, as coefficients of the multivariate 
Taylor series for logG^ [u(f)] centered at the point u(?) = 1. Because the m th term in © contains 
only multilinear combinations of u m , second-order and higher derivatives of these terms are zero. 
Consequently, the Taylor series for logG^ [u(f )] consists only of multilinear terms having (u m — 1) 
as its constituents with the cumulant moments as the series coefficients. Consequently, the jointly 
Poisson process can always be written in a form generalizing (f3]). This coefficient equals 



d k logGM[u(t)} 



du m {t)...du mk (t 



= £ II A m,l V,(f) (7) 

u(f)=l 1=1 \ m = m l,-,m k J 



Because matrix A has only binary-valued entries, the product Y\ m A m j equals either one or zero, 
bringing in the I th building block process only if it contributes to all of the constructed processes 
indexed by m\, .. . Note that the first partial derivative expresses the rate of each constructed 
process: X m {t) = Y,i A m,lVi{t) . 

We can normalize the Taylor series coefficient to obtain cumulant correlation coefficients by 
dividing by the geometric mean of the constructed process rates that enter into the partial derivative 
shown in (0. 



o {k) (f 



gMoggW [u(t)} 
A du mi (t)...dum k (t) 



u(t)=l 



Lf=l (j\m=mi,...,m k A m,l) v l{t) 

" [ZiA m ,iV l ( t )---Zl A mMt)} l/k 

Because the numerator expresses which building block processes are in common with all the spec- 
ified constructed processes, they and others are contained in each term in the denominator. This 
property means that each cumulant correlation coefficient is less than one and, since rates can- 
not be negative, greater than or equal to zero. Similar manipulations show that pjhi,...,m k (t) > 
Pmu-~jnk,m k+1 (0 : me s i ze °f the cumulant correlation coefficients cannot increase with order. 

In the symmetric case, the expression for the cumulant correlation coefficients simplifies greatly. 

The denominator is the rate A (t) of each constructed process and the numerator is the sum of the 
rates of the processes that induce the dependence of the specified order. This result makes it easier 
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to see that the cumulant correlation coefficients cannot increase in value with increasing order: 
<p( k '(t) <p( k ~ l \t) < l,k = 3,...,M. Furthermore, more stringent requirements can be derived 
by exploiting the structure equation ®, showing that the cumulant correlation coefficients must 
obey the following two relationships in the symmetric case. 



(9) 



k=m 

For example, for four jointly Poisson processes, the cumulant correlation coefficients must satisfy 
the inequalities 

3p( 2 )-3p( 3 )+p( 4 )<l 

p (2)_2p(3)+p(4)>0 

4 Relations to Jointly Bernoulli Processes 

Interestingly, this form of the jointly Poisson process can be derived as the limit of the jointly 
Bernoulli process when the event probability becomes arbitrarily small. First of all, a single Poisson 
process is defined this way, with the event probability equal to X{t)At. To extend this approach to 
two jointl y Poisson proces ses, we use the Sarmanov-Lancaster model for two jointly Bernoulli 



processes (jGoodman, 2004). Letting X\,X 2 be Bernoulli random variables with event probabilities 



P\,P2 respectively, the joint probability distribution is given by 

(X 1 -p 1 )(X 2 -P2) 



P(X l ,X 2 )=P(X 1 )P(X 2 ) 



1+p- 



where the standard deviation a, of each random variable equals U Pi(l — Pi). The key to the deriva- 
tion is to use the moment generating function, defined to be the two-dimensional z-transform of this 
joint distribution. 

*(zi,z 2 )=£I>(xi,* 2 )z^ 

xi xi 

Simple calculations show that for the jointly Bernoulli distribution given above, its moment gener- 
ating function is 

®(zi,z 2 ) = {0--p\)[\-p 2 )+pG\o 2 } + \p\{l-p 2 )-po\o 2 ]z\ + \p 2 {\ -Pi)-po l a 2 ]z2 

+ [PiP2+ P0i0 2 ]z\Z2 

= (1 +P\{zi - 1)) (1+^2(22 - 1)) + (zi - l)(z 2 - l)pcJia 2 
Letting event probabilities be proportional to the binwidth At, we evaluate this expression to first 



order in the event probabilities. Especially note that Oi o 2 ~ V Ai A2 At as At — > to first order. 
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Therefore, we have 

+ (zi - l)AiAf][l + (z 2 - 1)A 2 A ? ] + (zi - l)(z 2 - l)p\/A^A/ 
=1 +AiAf(zi - 1) + A 2 Af(z 2 - 1) +p v / ^A 2 ~A?(z 1 - l)(z 2 - 1) 

Evaluating the natural logarithm and using the approximation log(l +x) ~ x for small x, we find 
that 

log<J>(zi,z 2 ) ~ (zi - l)AiA? + ( Z2 - 1)A 2 A? + (zi - l)(z 2 - l)p V^Af 

If we sum the Bernoulli random variables in each process over a fixed time interval, say [0, T], we 
obtain the number of events that occur in each process. The moment generating function of this 
sum is the product of the individual joint moment generating functions, which means its logarithm 
equals the sum of the logarithms of the individual functions. Since the number of random variables 
increases as the binwidth decreases (equal to T /At) and noting these terms are proportional to At, 
the sum becomes an integral to yield 

log*(Ni,N 2 ) = (zi-l) [\(t)dt + {z 2 -l) f\(t)dt + (zi-l)(z2-l) [ T p(tWh(t)h(t)dt 
Jo Jo Jo 

If we let Xi{t) = Vi(t) + v c (?) and substitute ((U) for the definition of the correlation coefficient, 
we obtain the logarithm of the probability generating functional for two jointly Poisson processes 
constructed using Holgate's method in which m,(?) — > z; as in equation ([3]). 

Generalizing this result is tedious but straightforward: jointly Bernoulli processes converge in 
the limit of small event probabilities to jointly Poisson processes interdependent on each other at the 
same moment. An interesting sidelight is the normalization of the higher order dependency terms in 
the Sarmanov-Lancaster expansion demanded to make the correlation coefficient in the two models 
agree. In the Sarmanov-Lancaster expansion, the k th order term has the form exemplified by 

(k) (Xi-pi)---(Xk-pk) 

where Q is the normalization constant that depends on correlation order and the specific choice 
of random variables in the term. Normally, Sarmanov-Lancaster expansions consist of products of 
orthonormal functions, which in this case would be n(^' — Pi) I °i- This makes the putative normal- 
ization constant equal to Q = Y\Oj. However, the higher order correlation coefficients consequent 
of this definition have no guaranteed domains as does p( 2 \ As described above, the jointly Poisson 
correlation coefficients defined via cumulants do have an orderliness. Associating the two demands 
that correlation coefficient be defined as 

„) a E[(Xi-fi)-(X,-f t )] 
The normalization (nLi a l) l ^ k corresponds to the geometric mean of the variances found in the 
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definition ((51) of correlation coefficients for Poisson processes. In the context of the Sarmanov- 
Lancaster expansion, we have 

Solving for Q, we find that 



Using this normalization in the Sarmanov-Lancaster expansion now creates a direct relationship 
between its parameters and those of the jointly Poisson probability distributi on. The inequal ity sets 



1961). This 



shown in © also guarantee existence of the Sarmanov-Lancaster model (Ba hadur , 
change does not affect the orthogonality so crucial in defining the Sarmanov-Lancaster expansion, 
only the normality. 

Because of the correspondence between jointly Bernoulli processes and jointly Poisson pro- 
cesses, we can use the limit of the Sarmanov-Lancaster expansion to represent the joint distribution 
of jointly Poisson processes. In particular, we can evaluate information-theoretic quantities related 
to Poisson processes using this correspondence. Since entropy and mutual information are smooth 
quantities (infinitely differentiable), the small-probability limit can be evaluated after they are com- 
puted for Bernoulli processes. 
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